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Executive Summary 


n the past two decades, one of the most important 
I innovations in the US higher education system has 
been the steady increase in distance education through 
online courses. College administrators have expressed 
strong support for online education, signaling that the 
current online expansion will likely continue. Based 
on a national survey of college administrators, almost 
half of all postsecondary institutions now include 
expanding online learning as a crucial component in 
formal strategic plans. Almost two-thirds of college 
administrators believe that developing online courses 
is crucial for the long-term strategy of their institu- 
tion. Today, more colleges are offering online educa- 
tion courses, and more students are taking them than 
ever before. 

While the supply and demand for online higher 
education is rapidly expanding, questions remain 
regarding its potential impact on increasing access, 
reducing costs, and improving student outcomes. 
Does online education enhance access to higher 


education among students who would not otherwise 
enroll in college? Can online courses create savings 
for students by reducing funding constraints on post- 
secondary institutions? Will technological innova- 
tions improve the quality of online education? 

This report finds that, to varying degrees, online 
education can benefit some student populations. 
However, important caveats and trade-offs remain. 
Existing experimental and quasi-experimental stud- 
ies on semester-length college courses typically 
find negative effects on student course persistence 
and performance. Research suggests that students 
in online courses are between 3 percent and 15 per- 
cent more likely to withdraw, compared to similar 
students in face-to-face classes at community col- 
leges. This report examines distance learning’s effect 
on access, cost, and quality and concludes with a 
discussion about how strategies and policies can 
improve the effectiveness of online learning in higher 
education. 
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istance learning generally refers to education 
D that is delivered to students in remote locations. 
It includes a wide variety of learning environments 
that are different from the traditional brick-and-mor- 
tar classroom setting, such as telecommunication 
courses (in which instruction is delivered on video- 
tape or through cable distribution to students study- 
ing at home), correspondence study (in which the 
instructor mails or emails lessons to students who 
work independently), and online courses (in which 
course content is delivered via the internet, some- 
times through modules or websites). However, with 
advances in technology, online courses have become 
the primary format of distance education at postsec- 
ondary institutions. 

The growth of distance education was once inten- 
tionally constrained by the “so percent rule” of the 
Higher Education Act (HEA) of 1992.1 This rule denied 
federal funding for institutions with predominantly or 
exclusively distance education programs. Specifically, 
the rule dictated that institutions that offered more 
than 50 percent of their courses through distance edu- 
cation or enrolled more than half of their students 
in distance education courses would not be eligible 
for federal student aid programs such as Pell Grants, 
subsidized loans, and work-study funding. Since the 
50 percent rule applied to institutions instead of pro- 
grams, an education program could be composed 
entirely of traditional face-to-face courses and still lose 


its eligibility to federal student aid if it was offered at 
an institution that ran afoul of the 50 percent rule. Sim- 
ilarly, the HEA also denied access to certain types of 
federal financial aid and loans for students who took 
more than half their courses through distance courses.” 

While all institutions and students were subject 
to the 50 percent rule when offering and enrolling 
in distance education, the rule particularly affected 
nontraditional students who often balance course- 
work with other job and family commitments. The 
rule substantially constrained the growth of for-profit 
institutions, which had pioneered distance learning 
to allow individuals to pursue further forms of edu- 
cation.3 Since the for-profit sector disproportion- 
ately serves adult learners, women, underrepresented 
racial minority students, and low-income students, 
educational opportunities for the most disadvantaged 
populations were substantially compromised due to 
the 50 percent rule.4 

To promote new advances in distance education 
and to address the increasing demand, the HEA was 
amended in 1998 to create the Distance Education 
Demonstration Program (DEDP), which granted 
colleges waivers from the 50 percent rule. The 
DEDP-granted waivers grew from 15 institutions or 
university systems in 1999 to 24 in 2003, and the num- 
ber of off-site students enrolled in distance learning 
programs more than doubled during the same period.s 
In 2006, the HEA was amended again to discontinue 
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the 50 percent rule, thereby spurring the growth of 
dedicated online institutions. The share of bach- 
elor’s degrees awarded by institutions that offered 
exclusively online courses grew from 0.5 percent in 
2000 to over 6 percent in 2012.7 

At the state level, funding for online education 
programs and students enrolled in online classes var- 
ies. In 2015, the Education Commission of the States, 
through its State Financial Aid Redesign Project, ana- 
lyzed statutes and regulations for the largest 100 state 
financial aid programs across the country.® The report 
indicates that all states, except Pennsylvania, have 
eliminated the 50 percent rule from state-level poli- 
cies. Several states have also explicitly promoted the 
growth of online education in their state budgets. For 
example, California committed $100 million in 2018 
to create an online community college that will offer 
certificate and credentialing programs to primarily 
serve workers in need of new skills. The California 
state budget further committed another $20 million 
to expanding existing online offerings in the current 
brick-and-mortar campuses.? 

Now that higher education institutions are gener- 
ally unconstrained by state and federal policies from 
offering online and distance education courses, it is 
opportune to evaluate the benefits and drawbacks 
of online courses. How much has the expansion of 
online learning affected access to college, reduced 
costs, or improved student outcomes? 


Expanding Access: How Many Students 
Take Online Courses and Why? 


The literature on online learning identifies two pri- 
mary reasons that students take online courses. First, 
the online delivery format provides greater flexibility 
and convenience, especially for students who have 
other work and family commitments.!° The California 
Community College Chancellor’s Office (CCCCO) 
conducted a distance education survey among all stu- 
dents who completed a distance education course in 
the 2016 fall term." The survey asked distance edu- 
cation students to rank the importance of 16 reasons 
why they enrolled in a distance course.!2 Among the 


6,625 survey respondents (a 9 percent response rate), 
the number one reason was convenience with their 
work schedule. (Seventy-four percent of the respon- 
dents rated it as important or very important.) 

Second, individual student preferences about the 
course delivery drive enrollment in online educa- 
tion. Based on interviews with online course takers 
at two Virginia community colleges, Shanna Smith 
Jaggars found that students who prefer working 
independently and at their own pace are more likely 
to choose online courses.!3 In a similar vein, almost 
60 percent of the CCCCO student survey respon- 
dents were enrolled in distance courses because they 
“enjoy learning on a computer.”4 

Jaggars also found that students make conscious 
decisions on a course-by-course basis based on three 
factors specific to a course: (1) suitability of the sub- 
ject areas to the online context, (2) difficulty of the 
course, and (3) importance of the course. In general, 
the interviewed students seemed to have an implicit 
understanding that they would not learn the course 
materials as well when they took a course online rather 
than face-to-face.45 As a result, students were com- 
fortable taking online courses only when the course 
was easy (where “easy” was typically used to refer 
to humanities courses, whereas “difficult” referred 
to math and science courses), was less important to 
their academic career (such as courses not in their 
academic major), and was in a subject area they had 
less interest in. 

A number of students directly pointed out that 
they would take a course online only when they felt 
competent to “teach themselves” strictly from a 
textbook or other readings, with little or no explicit 
instruction. In contrast, students explicated the need 
for the immediate question-and-answer context of a 
face-to-face course in a subject in which they would 
need stronger instructor guidance. These findings 
suggest that many online courses implemented at 
community colleges, at least as currently practiced, 
may not support student learning as effectively as 
traditional face-to-face classes and therefore need 
systematic efforts from both the institution and the 
course instructors to better facilitate teaching and 
learning in the online environment. 
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Due to the flexibility of online learning, online 
courses may be particularly appealing to students 
who assume working and family responsibilities and 
who would otherwise have to take fewer courses or 
not enroll in college at all. A Government Account- 
ability Office report provided a comprehensive 
description of current online course takers based on 
data from the National Postsecondary Student Aid 
Study, a nationally representative survey covering 
more than 19 million postsecondary students.1 The 
analyses indicate that 1.5 million of 19 million post- 
secondary students took at least one online course 
in 1999-2000. These 1.5 million students differ from 
other postsecondary students in a number of ways. 
Compared to students who did not take any online 
courses during their entire program, online course 
attempters tend to be older and are more likely to be 
employed full time and attending school part time. 
They also have higher incomes and are more likely 
to be married. 

These patterns are also echoed in several studies 
using college administrative data. For example, based 
on data from California’s Community College Sys- 
tem, Hans Johnson and Marisol Cuellar Mejia found 
that students age 25 or older are much more likely 
than younger students to take online courses.17 Spe- 
cifically, 15.4 percent of older students take online 
courses, compared to 8.5 percent of their traditional 
college-aged peers (age 18-25). 

Additionally, this report reveals a racial and eth- 
nic difference in online enrollment, with Latino stu- 
dents having a substantially lower online enrollment 
rate than white, African American, or Asian students 
do. This disparity may partially reflect the broadband 
internet access divide, as research suggests that Lati- 
nos are typically less likely to have internet access 
at home.!8 Given the flexibility of online learning as 
the most important consideration students cited for 
enrolling in online courses and the demographic char- 
acteristics of the online course takers, it may seem 
self-evident that online courses provide an avenue to 
pursue higher education for individuals who other- 
wise would not enroll. However, there is surprisingly 
little causal evidence on whether the availability of 
online learning opportunities indeed increase access 


to higher education, especially for disadvantaged or 
underrepresented student groups. 

The only quasi-experimental evidence in this 
regard came from a recent study that uses data from 
anew online master’s of science in computer science 
(OMSCS) offered by the Georgia Institute of Tech- 
nology, in which all courses are delivered exclusively 
online.!9 The researchers found a significant differ- 
ence in the age of students applying for the online 
program and its in-person equivalent. Specifically, 
the average in-person applicant is a 24-year-old stu- 
dent recently out of college, whereas the average 
online applicant is a 34-year-old mid-career worker. 

A 2014 survey with OMSCS applicants also 
revealed that geographic and temporal flexibility 
is the primary appeal of online education to those 
whose jobs, families, or residential situations do not 
allow for enrollment in traditional programs. Eighty 
percent of those admitted to the online program 
accept those offers and enroll, suggesting that the 
online program expanded access to education for 
mid-career or older populations that would not oth- 
erwise enroll. Based on a regression discontinuity 
approach,?° the researchers find that access to this 
online option substantially increased overall enroll- 
ment by about 20 percentage points and that such 
effects are fairly consistent across different demo- 
graphic subgroups, such as by gender, ethnicity, age, 
and citizenship. Importantly, among applicants who 
fell right below the cutoff score and were therefore 
not admitted into the online program, few enrolled 
in other non-OMSCS programs, supporting the 
claim that the online option indeed increases access 
to higher education. 


The Supply and Demand of Online Education. 
With the added convenience of online classes and 
their potential ability to expand access to higher edu- 
cation, it should be no surprise that the supply of and 
demand for online courses has increased throughout 
the past decade. That is, more colleges are now offer- 
ing online courses than ever before (more supply), 
and more students are now enrolling in those courses 
than ever before (more demand). How large is this 
increase? The Department of Education’s Integrated 
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Postsecondary Education Data System (IPEDS) pro- 
vides comprehensive national statistics on postsec- 
ondary education, and since 2012, IPEDS has reported 
data regarding online education offerings and enroll- 
ment for degree-seeking students. 

IPEDS defines online education as a credit-bearing 
course or program in which the instructional con- 
tent is delivered exclusively online.2! IPEDS data 
from 2016-17 are used to show the overall increase in 
supply of online education courses and the increase 
in demand for those courses by students. The data 
represent more than 7,000 postsecondary institu- 
tions across the US, among which almost 5,000 are 
degree-granting institutions. 


The Supply Side: Increases in Online Courses and Pro- 
grams. In 2016-17, approximately 3,500, or 76 per- 
cent, of all degree-granting institutions reported 
offering online courses. This number has increased 
steadily since 2012, when 70 percent of those insti- 
tutions reported to offer online courses. Among 
institutions that offered any online course, almost 
all offered online courses at the undergraduate level, 
whereas only half offered online courses at the grad- 
uate level. While online courses provide flexibil- 
ity to students in general, programs offered entirely 
online allow students to attain a higher education 
credential remotely and thus could expand access to 
higher education among individuals who do not live 
near a physical college campus, such as those serv- 
ing in the Army. According to IPEDS, more than half 
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Figure 2. Number of Postsecondary Institutions That Offer Online Courses or Programs by 


Selectivity and Sector, 2012 and 2016 
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of degree-granting institutions offered at least one 
exclusively online program in 2016-17. 

Figure 1 shows the percentage of degree-granting 
postsecondary institutions that offer any online 
course and at least one exclusively online program, 
broken out by sector (public, private nonprofit, and 
private) and level (two year versus four year). Online 
learning is most prevalent in the public sector, where 
more than 9§ percent of public institutions offered 
at least one course online in 2016 and more than 
two-thirds of the institutions offered at least one pro- 
gram that can be pursued exclusively online. Online 
course and online program offerings are less prevalent 


in both the private nonprofit sector and the for-profit 
sector, especially at two-year institutions. 

Comparing data between 2012 and 2016 also reveals 
noticeable increases in the availability of exclusively 
online programs at both two-year and four-year insti- 
tutions in all three sectors. Among two-year public 
institutions, for example, only 415 (44 percent) institu- 
tions offered an exclusive online program in 2012. By 
2016, this number increased to 610, or 68 percent, of 
all degree-granting two-year public institutions. The 
only exceptions are for-profit two-year institutions, 
where only 15 percent of these institutions offered 
exclusively online programs in both 2012 and 2016. 
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Figure 2 further takes into account an institution’s 
selectivity and displays online course and program 
offering by sector among institutions with similar lev- 
els of selectivity. The selectivity measure is created 
by IPEDS based on several admission-related factors, 
such as college admission test scores, the number of 
applicants, and the number of students admitted.?2 In 
general, more selective institutions have lower accep- 
tance rates and tend to admit students with higher 
average entrance test scores (such as the SAT or 
ACT), suggesting that they predominantly admit the 
most academically qualified students. 

While online education offering is most prevalent 
among public institutions across the board, the gap 
in online course and program offering is particularly 
pronounced among the most selective institutions: 
During 2016-17, 91 percent of more selective public 
institutions offered at least one online course, com- 
pared to 63 percent of more selective private non- 
profit institutions. Similarly, whereas 76 percent of 
the more selective public institutions offered exclu- 
sively online programs, only 41 percent of the more 
selective nonprofit private institutions did so. 

IPEDS further divides exclusively online pro- 
grams by Classification of Instructional Programs 
(CIP) code, thus enabling a more detailed examina- 
tion of fully online programs by academic subject 
areas. Figure 3 presents the total number of educa- 
tion programs that can be pursued exclusively online 
at degree-granting institutions in each field of study. 
Due to variations in demand and the suitability of the 
online format in delivering the course content, the 
supply of fully online programs shows substantial 
variations across subject areas. Business and mar- 
keting top the list, where 7,437 programs can be pur- 
sued exclusively online and represent one-quarter 
of all programs in this area, followed by health 
(4,783 programs) and education (3,443 programs). 

To examine the possibility that the availability of 
fully online programs in each field may vary by the 
type of credential, we further break down the dis- 
tribution of programs for associate and bachelor’s 
degrees (Figure 4), graduate degrees (Figure 5), and 
certificates (Figure 6). It seems that business, health, 
and education are among the top three programs for 


all three types of credentials, with one exception: Rel- 
atively fewer associate and bachelor’s degree pro- 
grams in education can be fully pursued online (569 
programs, representing only 6 percent of all associate 
and bachelor’s programs in education). 

Finally, Figure 7 shows the distribution of pro- 
grams by sector and selectivity of institutions for the 
top five fields with the largest number of exclusively 
online programs.?4 Two interesting patterns emerge 
from the findings. First, except for education, fully 
online programs are overwhelmingly offered by non- 
selective public and private for-profit institutions. In 
particular, three-quarters of exclusively online com- 
puter science programs were offered by institutions 
from these two categories. Second, a relatively small 
percentage of exclusively online programs can be pur- 
sued at selective institutions. (Education is a notable 
exception, in which more than half of the programs 
are offered at selective institutions.) 


The Demand Side: Increases in Online Enrollment. 
Among all postsecondary degree-granting insti- 
tutions, 15 percent of all degree-seeking students 
were exclusively enrolled in online courses during 
2016-17, and approximately one-third of degree- 
seeking students were enrolled in at least one course 
through online learning (referred to as “any-online 
student” hereafter). There are substantial variations 
in student enrollment in online education across 
sectors: Private for-profit institutions, particularly 
for-profit four-year institutions, had the highest 
online enrollment rate, in which 68 percent of stu- 
dents enrolled in this sector during 2016-17 took at 
least one online class. Among these students, the 
majority (85 percent) were enrolled online exclu- 
sively (referred to as “only-online students” here- 
after). Institutions in the public sector and private 
nonprofit sector had a much lower online enroll- 
ment rate, in which 30 percent and 27 percent of 
students took at least one online class, respectively. 
Compared with any-online students enrolled in the 
for-profit sector, any-online students in the public 
and private nonprofit sectors were more likely to 
take face-to-face classes simultaneously, in which 
approximately one-third (35 percent) in the public 
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Figure 3. Availability of Exclusive Online Programs by Academic Subject Areas, 2016 
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Figure 4. Availability of Exclusive Online Associate or Bachelor’s Degree Programs by Academic 
Subject Areas, 2016 
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Figure 5. Availability of Exclusive Online Graduate Degree Programs by Academic Subject 
Areas, 2016 
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offering in 2016 (n = 4,566). Academic subject areas were retrieved from variable “CIPCODE” in the IPEDS database. 
Source: National Center for Education Statistics, Integrated Postsecondary Education Data System, 2016, httos://nces.ed.gov/ipeds/ 
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Figure 6. Availability of Exclusive Online Certificate Programs by Academic Subject Areas, 2016 
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offering in 2016 (n = 4,566). Academic subject areas were retrieved from variable “CIPCODE” in the IPEDS database. 
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Figure 7. Top Five Fields with the Largest Number of Online Programs by Sector and Selectivity, 2016 
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sector and 65 percent in the private nonprofit sector Overall, the shares of online students (both any-online 
were enrolled in online courses exclusively. and only-online students) increased steadily across 

Figure 8 shows the overall changes in student all three sectors between 2012 and 2016. While the 
enrollment in online courses between 2012 and 2016 total number of online students slightly increased 
across all degree-granting postsecondary institu- during the five-year period in both the public and pri- 
tions. The number of any-online students increased vate nonprofit sectors, the number of online students 


by one million, representing a 19 percent increase at private for-profit colleges declined, which seems to 
overall. The number of only-online students also be primarily driven by the overall shrinkage of total 
increased by 0.3 million during this period, or a student enrollment in this sector during this period. 
12 percent increase. The nationwide increase in To examine possible differences in online enroll- 
online enrollment displayed in IPEDS is also evident ment between two-year and four-year colleges, Fig- 
in state and local reporting. At California Commu- ure 10 further differentiates between four-year and 
nity Colleges (the largest community college sys- two-year institutions in each sector and shows the 
tem in the US) online course enrollment increased percentage of students enrolled in any online course 
by almost 850,000 between 2002 and 2012. Mean- in 2012 and 2016, respectively. Overall, the percent- 
while, enrollment in face-to-face classes declined age of any-online and only-online students increased 
by almost 285,000. Consequently, the proportion of in both two-year and four-year colleges across all 
online course enrollment surged from 1.4 percent to sectors. In the public sector, two-year institutions 
10.7 percent over this period.*5 had slightly higher online enrollment rates than 
Figure 9 further displays the trends of any-online did four-year institutions in both 2012 (27 percent 
and only-online students by institutional sector. vs. 22 percent for any-online and 10 percent vs. 
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Figure 8. Number of Students Enrolled in Postsecondary Degree-Granting Institutions and 


Online Courses, 2012-16 
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7 percent for only-online) and 2016 (31 percent vs. 
29 percent for any-online and 12 percent vs. 10 per- 
cent for only-online). In the private nonprofit sector, 
two-year institutions showed a dramatic increase in 
online enrollment rate between 2012 and 2016 (from 
7 percent to 40 percent for any-online and from 
2 percent to 34 percent for only-online), although 
these two-year institutions only accounted for less 
than 1 percent of the total postsecondary enroll- 
ment. In the private for-profit sector, four-year insti- 
tutions had an extremely high online enrollment 
rate (80 percent for any-online and 69 percent for 
only-online in 2016), while the rate was fairly low at 
two-year, private for-profit institutions (13 percent 
for any-online and 4 percent for only-online in 2016). 

Figure 11 displays the percentage of any-online 
and only-online students by institutional selectivity. 
The patterns across institutions are strikingly consis- 
tent: the more selective an institution, the less likely 
the students would attempt any online course. For 
example, only 16 percent of the students enrolled 
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in most-selective institutions attempted any online 
course during 2016-17, which is half the rate com- 
pared to students enrolled at nonselective institu- 
tions (39 percent). 

The higher rate of online enrollment among non- 
selective institutions shown in Figure 11 might be 
primarily driven by a large share of students enrolled 
at private for-profit institutions. To address this pos- 
sibility, Figure 12 shows the percentage of students 
enrolled in online courses broken out by sector in 
each category of selectivity. After disaggregating the 
data by both sector and selectivity level, the pat- 
tern of higher online enrollment rate in nonselec- 
tive institutions holds in the public sector and the 
private nonprofit sector. For example, in the private 
nonprofit sector, only 10 percent of the students at 
more selective institutions took any online course 
in 2016-17. The percentage of any-online students 
almost tripled at moderately selective nonprofit 
institutions and increased by about half at nonselec- 
tive nonprofit institutions. 
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Figure 9. Number of Students Enrolled in Postsecondary Institutions and Online Courses by 


Sector, 2012-16 
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Figure 10. Higher Education and Online Enrollment by Sector and Level, 2012 and 2016 
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Finally, considering that state-level policies may 
shape online learning in unique ways, Figure 13 shows 
online enrollment by state in the 2016-17 school 
year. Unsurprisingly, the most populated states, such 
as California, Florida, and Texas, also had the largest 
number of online course takers. Once accounting for 
between-state differences in overall higher educa- 
tion enrollment, four states have the largest share of 
students who enrolled in at least one online course 
in 2016: Arizona (61 percent), Idaho (52 percent), 
New Hampshire (58 percent), and West Virginia 
(57 percent). At the other end of the spectrum, three 
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states—Connecticut, New York, and Rhode Island— 
had less than 20 percent of students enrolled in at 
least one online course. 


The Cost of Online Education: Can 
Distance Learning “Bend the Cost 
Curve”? 


One reason for the support behind online edu- 
cation and distance learning is that it can help 
address funding insufficiencies in higher education 
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Figure 11. Higher Education and Online Enrollment by Selectivity, 2012 and 2016 
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IPEDS 2012 database, respectively). 


Source: National Center for Education Statistics, Integrated Postsecondary Education Data System, 2012 and 2016, https://nces. 
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by reconfiguring the use of highly paid faculty and 
reducing the demand for brick-and-mortar construc- 
tion and maintenance.”° Since online courses do not 
have physical space limitations on enrollment, col- 
leges can increase class sizes in online courses as 
a response to changes in demand relatively easily 
compared to brick-and-mortar classrooms. More- 
over, the consequence associated with increased 
class size on student learning may also differ sub- 
stantially by course delivery format: While larger 
class sizes can negatively influence student-learning 


17 


outcomes through increased classroom disruptions 
in the traditional face-to-face setting, these mecha- 
nisms would be largely muted if an online course has 
limited synchronous student-instructor interactions 
and peer interactions.?7 

Eric Bettinger and his coauthors directly assess 
the effects of increasing class size on student- 
learning outcomes in online courses at a large 
for-profit university.2® The authors exploit a field 
experiment in which more than 4,000 course sec- 
tions of 111 courses were randomly assigned to either 


THE PROMISES AND LIMITS OF ONLINE HIGHER EDUCATION DI XU AND YING XU 


Figure 12. Higher Education and Online Enrollment by Sector and Selectivity, 2012 and 2016 
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Figure 13. Percentage of Students Enrolled in Any Online Course by State, 2016 
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regular-sized classes of 31 students or slightly larger 
classes with an average 10 percent increase in class 
size. They estimate the effect of online class size ona 
variety of student outcomes. The authors find, after 
addressing potentially endogenous student sort- 
ing into different classes, that increasing the online 
class size by 10 percent has no statistically signifi- 
cant effect on either current course grade or subse- 
quent course enrollment. The null results suggest 
that online courses have the potential to reduce the 
cost of providing education by increasing online 
class size without affecting student outcomes. 

If online course offerings can indeed serve as 
cost-saving innovations for institutions, colleges 
may also charge lower tuition for their online pro- 
grams and courses, therefore lowering the costs 
for students to pursue postsecondary education. 
Indeed, using IPEDS, David Deming and his coau- 
thors found that institutions with higher shares of 
students enrolled online charge lower prices, provid- 
ing some suggestive evidence that online education 
might be able to “bend the cost curve” in traditional 
higher education.?9 


Caveats Against Online Courses as a Cost- 
Saving Strategy. At first, these results seem to pro- 
vide evidence that online courses present a prom- 
ising opportunity to reduce higher education costs 
for both institutions and students. A caveat against 
this promise, however, is the extent to which online 
courses and programs compromise the quality 
of education received compared with traditional 
face-to-face instruction. If the primary reason why 
online class size can be increased without degrading 
learning outcomes is that interpersonal interactions 
are muted enough in online classrooms, it is reason- 
able to question whether the reduced interpersonal 
interactions and social presence may compromise 
the quality of education received by students. In 
fact, in a separate paper that uses the same data set 
from a large for-profit university, Bettinger and his 
coauthors find that online courses do significantly 
less to promote student academic success than sim- 
ilar in-person courses do.3° The negative associa- 
tion between online learning and student-learning 
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outcomes, which is discussed in detail below, indi- 
cates that college online courses do not currently 
support student learning equally as well as face-to- 
face classes. Thus, perhaps a more compelling ques- 
tion is whether online technology has the potential to 
deliver similar quality of education in a less expensive 
way relative to brick-and-mortar instruction. 

Another important caveat to the promise of 
online education is the large upfront cost of devel- 
oping high-quality online courses. The complexi- 
ties involved in making generalizations about costs 
across different types of courses and institutions 
make it extremely difficult, if not entirely impos- 
sible, to provide a clear-cut answer as to whether 
online courses are indeed cheaper in terms of both 
upfront costs in course development and recur- 
ring costs in course delivery.3! For example, Rus- 
sell Poulin and Terri Taylor Straut noted substantial 
variations in how an online course is designed and 
implemented, ranging from a set of slides with little 
student-instructor interaction to a highly interactive 
course with well-designed videos of lectures.3? As a 
result, development costs for online courses can vary 
widely across institutions from $10,000 to $60,000 
per course, depending on a variety of factors such as 
specific online course design features, student ser- 
vices, and faculty compensation.33 

Based on expenditure data from the University of 
North Carolina (UNC) system, a recent report pro- 
vides suggestive evidence that well-designed online 
courses with technologically enabled interaction 
between students and instructors are more expen- 
sive than traditional on-campus courses in terms of 
both startup expenditures in course development 
and recurring expenditures in delivering the course.34 
More specifically, based on the cost information on 
a sample of 92 courses (46 on-campus and 46 dis- 
tance courses) from 15 UNC campuses,35 the report 
indicates that the average cost for developing a dis- 
tance course ($5,387) is 6 percent higher than the 
average cost for developing an on-campus course 
($5,103).3© The higher costs associated with devel- 
oping online courses are primarily driven by higher 
expenses for staff or consultants that assist faculty 
in course development. In terms of course delivery, 


THE PROMISES AND LIMITS OF ONLINE HIGHER EDUCATION 


DI XU AND YING XU 


the cost for delivering an online course ($17,564) is 
also higher than the average cost for delivering an 
on-campus course ($16,433), which is due to distance 
education courses often having other costs associated 
with delivery that on-campus courses do not incur, 
such as special software or hardware needed for con- 
tent delivery or technologically enabled interaction 
between students and instructors.37 

Most interestingly, the average class size for dis- 
tance education courses was significantly smaller than 
the average size for on-campus courses (18 vs. 23), and 
faculty in follow-up campus interviews emphasized 
the need to maintain smaller class sizes for online 
courses specifically because “teaching online courses 
is more time consuming for faculty” and “due to the 
amount of work necessary to engage students in the 
online environment.”3° That faculty might need to 
spend more time to ensure the quality of instruction 
and interaction in an online course than in face-to- 
face classes raises questions on the potential of online 
courses to serve as a cost-saving strategy through 
larger class size. 

If cost saving is not the primary reason for insti- 
tutions to offer online courses, then why do postsec- 
ondaryinstitutions generally agree on the importance 
of expanding online learning? Interviews conducted 
by Lawrence Bacow and his coauthors identified two 
major reasons for providing online learning oppor- 
tunities. First, many institutions view online educa- 
tion as an important new revenue source, as it may 
generate new revenue streams by reaching students 
who would not otherwise enroll in traditional degree 
programs.39 Second, most institutions intend to use 
online learning as a way to improve students’ learn- 
ing experience. 

Specifically, several administrators noted online 
learning as an effective way to address space con- 
straints, particularly in low-division, high-demand 
introductory courses—an issue many institutions are 
facing due to the increasing demand for higher educa- 
tion. Freedom from the constraint of physical class- 
room space allows administrators to create as many 
course sections as they can find qualified instructors 
for, which could address the availability barrier. In 
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addition, online learning may also expand access to 
better educational resources: While small colleges do 
not always have the resources to offer a wide range 
of courses to their students, shared online courses 
allow these campuses to offer students a wider vari- 
ety of courses. Finally, college administrators are also 
optimistic about online courses potentially reforming 
the traditional learning process through technology, 
such as enabling a greater level of learning flexibility, 
achieving strong computer-mediated student-to-stu- 
dent interaction and collaboration, and providing 
immediate personalized feedback on student learning. 


Online Education and Student Outcomes 


With the rapid growth of online education and its 
potential benefits to address the needs of diverse 
student populations, questions remain regarding its 
effectiveness.4° Do online courses effectively pre- 
pare students with the knowledge and skills needed 
to succeed in college and later in their careers? Ear- 
lier observational studies attempted to compare 
student-learning outcomes between online and 
face-to-face formats, and the findings are mixed.4! 
Such discrepancies in research findings might be par- 
tially explained by the issue of “self-selection”: Most 
of these observational studies simply made compari- 
sons between students who opted to take the course 
online and those who self-selected into the tradi- 
tional face-to-face format and, therefore, did not 
control for the possibility that a common set of per- 
sonal characteristics and school circumstances may 
jointly influence decisions on online course enroll- 
ment and course outcomes. As a result, the extent 
to which these statistical findings are attributable to 
cause-effect relationships remains uncertain. 

To provide an overview of the causal link between 
course delivery format and student-learning out- 
comes, we reviewed the literature that uses exper- 
imental or quasi-experimental research design to 
control for student sorting by course delivery format. 
Appendix A summarizes the key information of each 
study discussed below. 
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Online Delivery Format Improves Learning 
Outcomes. The strongest support for the optimism 
around online learning comes from a meta-analysis 
by the US Department of Education.4? Based on only 
randomized experiments or quasi-experiments, the 
meta-analysis suggests that, on average, students in 
online learning conditions performed better than did 
those receiving face-to-face instruction.43 However, a 
thorough review by Jaggars and Thomas Bailey of the 
45 experimental studies included in the meta-analysis 
raises concerns regarding whether the findings from 
the Department of Education report could be gener- 
alizable to typical college courses.44 

First, the majority of the studies included in this 
meta-analysis focused on only one specific topic, in 
which the duration of the intervention could be as 
short as only 15 minutes. Results from these short 
interventions may not speak to the challenging issues 
inherent in maintaining student attention and moti- 
vation over a course of several months. Among all the 
45 studies included, only seven were relevant to typi- 
cal online semester-length college courses.45 Overall, 
these seven studies showed no strong advantage or 
disadvantage in terms of learning outcomes among 
students who stayed in the course throughout the 
entire semester.4° However, all seven studies were 
conducted at midsize or large universities, with five 
rated as “selective” or “highly selective” by US News 
and World Report, and all seemed to involve relatively 
well-prepared students. 

These results may not speak to academically under- 
prepared students who may struggle more in online 
learning environments due to poor time-management 
and independent-learning skills, which are thought 
to be crucial to success in online education, or due 
to technical difficulties, such as slowness of typing, 
problems navigating the course management system, 
and difficulty following material on the screen. These 
are all problems that may be more common among 
students with weak educational backgrounds.47 
Only one of the studies examined the impacts of 
the course delivery format on lower-performing stu- 
dents. Cynthia Peterson and Nathan Bond performed 
a descriptive analysis suggesting that the lowest 
third of academically prepared students performed 
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substantially better in the face-to-face setting than in 
the online setting.48 

In addition, the studies included in the meta- 
analysis almost exclusively focus on course grade and 
do not study attrition as an outcome. While course 
attrition rates might be low and ignorable in a selec- 
tive institution with an academically well-prepared 
student population, a large proportion of students 
enrolled in open-access public institutions, especially 
at two-year community colleges, are academically 
underprepared. These underprepared students with- 
draw from courses and drop out of college at a higher 
rate.49 Indeed, studies consistently identify higher 
course attrition rates in online courses compared to 
similar face-to-face courses at two-year colleges.5° If 
less academically prepared students are more likely to 
withdraw due to the online nature of the delivery for- 
mat, it may not be surprising, then, that students who 
stayed in the online course were more likely to earn a 
good grade than were students who took face-to-face 
courses. 

Finally, several studies in the meta-analysis were 
conducted by professors who taught the course in 
subjects likely to be especially well-suited to online 
learning, such as computer programming. These 
professors were either online course advocators or 
potentially highly motivated professors teaching 
unusually high-quality online classes. The classes 
often involved synchronous sessions, timely instruc- 
tor feedback, effective technical support, a clear 
grading rubric, and a well-organized course struc- 
ture with intuitive navigation. Yet, the quality of 
the courses designed and offered by these online 
advocates may not represent typical online courses 
offered at colleges. Indeed, studies that examine the 
design features of online courses currently offered at 
postsecondary institutions, especially open-access 
public colleges, noted that many instructors sim- 
ply transfer their in-person pedagogy to the online 
format and include a minimal level of synchronous 
interpersonal interaction opportunities.5! 


Online Delivery Format Hinders Learning Out- 
comes. Aside from the meta-analysis, all other 
experimental and quasi-experimental studies on 
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semester-length college courses find negative effects 
on student course performance, course persistence, 
and other downstream learning outcomes such as 
course repetition and subject persistence. The effect 
of taking online courses on these outcome metrics is 
explored in detail below. 


Course Performance. Nearly all causal studies find 
negative effects of online course taking on student 
course performance or, at best, null results.52 The 
outcome measures include course grades, course 
completion with a passing grade, and standardized 
posttest scores.53 

Four experimental studies are conducted in rela- 
tively selective four-year institutions and randomly 
assign students into different delivery formats in a 
single course in economics or statistics with a total 
enrollment ranging between 312 and 725 students.54 
David Figlio, Mark Rush, and Lu Yin compare between 
a purely online and face-to-face classroom setting in 
teaching microeconomics principles, in which stu- 
dents assigned to the online format watch videos of 
the lectures online.55 Ted Joyce and his coauthors also 
conducted the study in principles of microeconom- 
ics, but the online instruction in their study instead 
takes the form of blended learning that included an 
online component and reduced the weekly face-to- 
face meeting time by half.s® 

William Bowen and his coauthors compare an 
online delivery format with one hour per week of 
instructor contact time to a purely face-to-face deliv- 
ery format with three hours per week of contact 
time in a statistics course by randomly assigning stu- 
dents on six public university campuses.‘7 The online 
instruction in their study is the most sophisticated 
among the four studies, which includes an interactive 
learning system that provides students with custom- 
ized machine-guided instruction and timely informa- 
tion about student performance to course instructors 
for more targeted and effective guidance from the 
instructor. Additionally, the blended group is also 
accompanied by one hour of face-to-face instruc- 
tion each week. William Alpert and his coauthors 
compared student-learning outcomes in a micro- 
economic principle course delivered through three 
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formats—face-to-face, blended, and fully online— 
at a public university.s® Both the blended and the 
online formats provide students with online lectures; 
additionally, students in the blended format attend 
a weekly in-person discussion session, whereas stu- 
dents in the fully online format attend a weekly online 
synchronous discussion session. 

Except for Bowen and his coauthors who iden- 
tify no significant difference in learning outcomes 
between the blended and face-to-face instruction, the 
other three all find negative effects of online instruc- 
tion on course grades.5? Bowen and his coauthors 
point out that one potential explanation for the null 
effects in their study versus more negative impacts 
in other studies may be due to the form of online 
instruction: The online course examined in their 
study uses an advanced, less commonly used interac- 
tive learning system with machine-guided protocols, 
whereas the online instruction in the rest of the stud- 
ies is mainly through videotaped lectures that do not 
enable student-faculty interactions.®° 

While well identified, all the experimental stud- 
ies focus on a small number of students in a specific 
course and therefore shed limited insights on the 
impacts of online learning in the broad set of col- 
lege courses. A handful of studies address this issue 
by using college administrative data that include a 
large swath of online and face-to-face courses at one 
college or multiple colleges in an entire state. The 
majority of these quasi-experimental studies exam- 
ine online learning at two-year community colleges, 
which is a population of particular interest for pol- 
icy on online learning.®? Four state community col- 
lege systems have been examined thus far (California, 
North Carolina, Virginia, and Washington), and all 
states demonstrate rapid growth of enrollment in 
fully online courses during the past decade.®3 

Using different quasi-experimental methods to 
address student sorting into online courses and 
drawing on data from different states and settings, 
the results from the quasi-experimental studies find 
patterns that are strikingly similar: Students in fully 
online delivery formats had learning outcomes that 
were substantially worse than those in the face-to- 
face section of the same course.®4 The current 
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evidence on the negative effects of online deliv- 
ery format are primarily based on data from a large 
swath of courses at nonselective institutions, such 
as for-profit four-year colleges or two-year commu- 
nity colleges.®5 In contrast, all the studies conducted 
at selective four-year institutions involve only a few 
hundred students enrolled in one specific course. 
As a result, it is uncertain whether the consistent 
and substantial performance decrement observed at 
the nonselective institutions also speaks to online 
courses at four-year colleges. We do know, however, 
compared to the robust and sizable negative impacts 
of online learning identified across all studies con- 
ducted at nonselective institutions, the studies con- 
ducted at relatively selective four-year institutions 
yield mixed findings; even among studies that iden- 
tified a negative association between online deliv- 
ery and student-learning outcomes, the magnitude 
of the negative effects also tend to be smaller com- 
pared with those based on student course perfor- 
mance at two-year or for-profit colleges. 

One concern that is often raised about compari- 
sons between the online and face-to-face sections of 
a course without randomized controlled trials is that 
there might be systematic differences between instruc- 
tors teaching the online and face-to-face sections. 
For example, if more experienced and high-quality 
instructors avoid teaching courses online, the neg- 
ative effects identified by these quasi-experimental 
studies might be partly attributable to teacher pro- 
ductivity. Cassandra Hart and her coauthors directly 
assessed the extent of this problem by including a 
rich set of instructor characteristics into the fixed 
effects model.© Their analyses indicate that includ- 
ing observable instructor characteristics does little to 
alter the negative relationship between online course 
taking and student performance.°7 


Course Persistence. While course persistence—mea- 
sured as making it through the entire semester of a 
class—is generally high at four-year colleges, course 
attrition is a serious issue at open-access institutions, 
particularly at two-year community colleges, where a 
large proportion of students withdraw before the end 
of a course at a high rate.®8 This particular retention 
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problem in community colleges is even worse with 
online courses. Indeed, most community colleges 
acknowledge that online course dropout rates are 
higher, although it is not clear whether these dropout 
rates are due to the online course format or the char- 
acteristics of students who choose that course format 
based on simple raw comparisons. 

Four quasi-experimental studies explicitly examine 
the causal impacts of online delivery format on course 
persistence at the four state community college systems 
mentioned above, and all identified sizable negative 
impacts of online course taking on course persistence. 
The research finds that students in online courses are 
between 3 percentage points and 15 percentage points 
more likely to withdraw from the course, compared to 
similar students taking face-to-face classes, depend- 
ing on the state examined and the statistical method 
used.©9 Students who withdraw during the add and 
drop period were not included in the analysis. As a 
result, midsemester course withdrawal penalizes stu- 
dents not only academically—students do not obtain 
any credit from the course and a grade of “W” also 
appears on their permanent record—but also econom- 
ically, since students who withdraw after the add and 
drop period pay full tuition for the course and do not 
receive any refund for the course. 


Downstream Outcomes. A handful of studies examined 
whether online delivery format influences students’ 
downstream outcomes, including course repetition, 
defined as whether a student retakes the same course; 
subject persistence, defined as future enrollment 
in other classes in the same subject area; follow-up 
course grades; and college persistence—as opposed 
to dropping out of college after that term.7° 

Using a multi-way fixed effects model, Hart and 
her coauthors find that online course taking is pos- 
itively associated with course repetition and neg- 
atively associated with subject persistence at the 
California Community Colleges.7! Based on tran- 
script records from nearly 40,000 students at a large 
comprehensive university over a 10-year period, John 
Krieg and Steven Henson match each course with all 
subsequent courses for which it is a prerequisite and 
used an instrumental variable approach to control for 
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student sorting by course delivery format.7? They find 
that students taking online prerequisite courses earn 
lower grades compared to students who took the pre- 
requisite face-to-face. 

The sizable negative impacts of online learning 
on subject persistence into the next course may be 
driven by two distinct sources: An uninspiring expe- 
rience in a course may reduce the student’s probabil- 
ity of either taking another course in a particular field 
or dropping out from college completely. While both 
are undesirable, the latter is particularly worrisome, 
since completing college—not just enrolling in it— 
is imperative with economic opportunity, especially 
among disadvantaged populations. 

Regression analyses also find that taking online 
courses has a negative effect on college persistence. 
After controlling for multiple observable covariates, 
numerous studies find that students who take online 
courses are less likely to persist in college and attain a 
degree.73 For example, based on data from Washing- 
ton community colleges, Nick Huntington-Klein and 
his coauthors find a negative effect of 2 percentage 
points of taking an online course on the probability of 
earning a degree. Based on data from Virginia Com- 
munity College System, Jaggars and Xu also find that 
students who took at least one online course in their 
first semester at college were 5 percentage points less 
likely to return for the subsequent semester and stu- 
dents who took a higher proportion of credits online 
were significantly less likely to attain any credential or 
transfer to a four-year college.”4 

Given the robust negative impacts of online learn- 
ing on concurrent and subsequent course perfor- 
mance, the question then is whether the expansion of 
online learning may negatively influence a student’s 
eventual labor market performance, such as average 
employment rate and income level. Unfortunately, 
experimental or quasi-experimental studies that can 
estimate the causal impact of exposure to online 
learning and labor market outcomes are still missing 
from the literature. 


Heterogeneous Impact by Student and Course 
Characteristics. A handful of experimental and 
quasi-experimental studies compared the size of the 
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online performance decrement by a number of stu- 
dent characteristics and found strikingly consistent 
patterns.75 Specifically, the performance gaps between 
online and face-to-face learning seem to be particu- 
larly strong among underrepresented racial minority 
students, younger students, students with lower lev- 
els of academic preparation, students with part-time 
enrollment, and students who do not intend to trans- 
fer to a four-year institution. Since most of these 
subgroups already tend to have poorer academic 
outcomes overall, the achievement gaps that existed 
among these subgroups in face-to-face courses 
became even more pronounced in online courses. For 
example, in California Community Colleges, among 
online course takers, the average gap between white 
and African American students in course completion 
with a passing grade increased by 5 percentage points, 
from 13 percentage points to 18 percentage points, 
representing an almost 40 percent increase.7® 

In addition to online performance gaps by student 
subpopulations, a number of studies also found that 
the online performance gap varied across academic 
subject areas.77 For example, based on data from the 
Washington community college system, Xu and Jag- 
gars found that some of the variability in the online 
performance gap across academic subject areas 
seemed due to peer effects: Regardless of their own 
characteristics, students experienced stronger online 
performance decrement when they took courses in 
subject areas in which a larger proportion of peers 
are at risk for performing poorly online.7® Perhaps 
in online courses with a high proportion of students 
who are struggling in the online environment, inter- 
personal interactions and group projects are more 
challenging than they would be with the same group 
of students in the face-to-face setting. Or perhaps 
instructors need to respond to highly demanding stu- 
dents, thereby decreasing the support to other stu- 
dents enrolled in the class. 

After removing the effects of measurable indi- 
vidual and peer characteristics, the authors further 
identified two subject areas that demonstrated sig- 
nificant online performance gaps: the social sciences 
(e.g., anthropology, philosophy, and psychology) and 
the applied professions (business, law, and nursing). 
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These subject areas may require a high degree of 
hands-on demonstration and practice or require 
intensive interactions between faculty and students, 
which studies have suggested are more difficult to 
effectively implement in the online context.79 

The results regarding the relative impact of online 
learning across subject areas are less consistent 
across studies, partly due to the different ways that 
researchers categorize courses. For example, using 
data from California Community Colleges, Hart and 
her coauthors divide all courses into five broad dis- 
ciplines (social sciences, business and management, 
humanities, information technology, and math) and 
find that the online performance decrement is partic- 
ularly pronounced in math and humanities classes.8° 
Also using data from California Community Colleges, 
Johnson and Mejia provide a much more detailed 
subject categorization that includes 17 subject areas 
in total.8! They find that students enrolled in public 
and protective services, engineering, and media and 
communications suffer from the largest online per- 
formance penalty. Despite the variations in effect 
sizes, the online performance gaps are observed con- 
sistently across student subgroups and by different 
subject areas. 


What Explains Online Performance Decrement? 
Why do students struggle more in fully online courses? 
Practitioners and scholars increasingly acknowl- 
edge two crucial challenges to successful learning in 
an online environment: requirement of higher-level 
self-directed learning skills and greater difficulties in 
enabling effective human interactions. On top of these 
challenges, individual differences in technology liter- 
acy and unequal access to computers and internet may 
also hinder some students’ online learning effective- 
ness. For example, in 2010, only 55 percent of African 
Americans and §7 percent of Hispanics had high-speed 
internet access at home, compared to 72 percent of 
Caucasian and 81 percent of Asians.®2 

Unlike face-to-face courses in which students 
attend course lectures at a fixed time, students work- 
ing in a fully virtual environment are required to 
plan out when they will watch the course lectures 
and work on corresponding assignments. Even in 
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high-quality online courses, students must learn 
course materials independently, manage time wisely, 
keep track of progress on course assignments, over- 
come technical difficulties and the feeling of isolation, 
and take the initiative to communicate with instruc- 
tors and peers for questions and group assignments.®3 
As such, online learning has been recognized as a 
highly “learner-autonomous” process that requires 
high levels of self-motivation, self-direction, and self- 
discipline to succeed.84 

Granted, these skills are important to success in 
any learning environment, but they are more cru- 
cial to effective online education. A recent national 
report on online learning finds that more than 
two-thirds of academic leaders believe that “stu- 
dents need more discipline to succeed in an online 
course than in a face-to-face course.”85 Thus, while 
we would expect students with lower self-directed 
learning skills to fare more poorly in any course 
compared to their more-prepared peers, students 
with insufficient time management and self-directed 
learning skills may struggle particularly in an online 
learning environment. 

Similarly, the lack of interpersonal connections 
in online courses imposes at least two additional 
challenges on students. First, due to the absence of 
physically present peers and their behaviors, social 
comparisons are limited. Extensive research from 
psychology indicates that making comparisons to 
peers is one of the fundamental ways through which 
students adjust and regulate their behaviors during 
the learning process.®¢ In traditional classrooms, peer 
comparisons happen naturally with the physical pres- 
ence and visibility of classmates. However, such affor- 
dance of social comparison is missing in most online 
courses. With sparse social and normative signals, 
online learners need to regulate their learning process 
independently, which can affect learning outcomes. 

Second, computer-mediated communications are 
often criticized as inherently impersonal since non- 
verbal and relational cues—common in face-to-face 
communication—are generally missing. Despite the 
high potential of leveraging advanced technology to 
facilitate peer-peer and student-instructor interac- 
tions, most of the online courses, particularly those 
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offered at public open-access institutions, involve 
limited peer interactions and student-faculty inter- 
actions.87 Low levels of social presence may lead to 
increased feelings of loneliness and isolation, which 
has negative effects on course persistence and learn- 
ing performance.*8 

The evidence reviewed above indicates that most 
students tend to perform worse in online settings 
compared to face-to-face classes, but the perfor- 
mance decrement is particularly strong among cer- 
tain subpopulations. Literature suggests that female 
students, white students, older students, and individ- 
uals with high prior educational attainment on aver- 
age have a higher level of self-directed readiness than 
do male students, black students, and individuals 
with lower educational attainment.89 As Michael Zas- 
trocky, research director for academic strategies for 
the Gartner Group, stated, “There are some students 
who really do not do well outside a traditional class- 
room. There are some who do very well.”9° 


Strategies to Improve Online Education 


Based on the growing knowledge regarding the spe- 
cific challenges of online learning and possible course 
design features that could better support students, 
several potential strategies have emerged to promote 
student learning in semester-long online courses. The 
teaching and learning literature has a much longer 
list of recommended instructional practices. How- 
ever, research on improving online learning focuses 
on practices that are particularly relevant in vir- 
tual learning environments. These include strategic 
course offering, student counseling, interpersonal 
interaction, warning and monitoring, and the profes- 
sional development of faculty. 


Strategic Online Course Offering. Above all, given 
students’ differential ability to successfully learn in 
an online environment, colleges may need to be more 
strategic in online course offerings. Considering that 
the convenience of online learning is most valuable 
to adults with multiple responsibilities and that older 
students typically have a higher level of self-directed 
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learning skills, colleges may be able to expand online 
learning more drastically in courses or programs 
enrolling a large proportion of adult learners.%! In 
contrast, in lower-division courses in which the 
majority of students are fresh high school graduates, 
colleges may need to provide more face-to-face inter- 
action opportunities and support to the students. To 
combine the benefits from both delivery formats, 
one popular approach many colleges have adopted is 
replacing part of the traditional face-to-face time with 
online learning or a hybrid course. This strategy could 
partly address issues of resource constraints but will 
also largely overcome the challenges associated with 
learning in a fully virtual environment. 


Student Counseling. When students struggle 
academically, they may benefit from institutional 
resources and supports, such as counseling and tutor- 
ing services.92 However, since online students often 
choose the format to accommodate work and fam- 
ily responsibilities, they may face challenges access- 
ing these supports if they are delivered exclusively 
on campus.93 To better address the need of the grow- 
ing online student population, especially those who 
enroll exclusively online, many colleges have started 
to provide comprehensive counseling and tutoring 
through the online format. 

For example, the California Community College 
System established the Online Education Initiative 
(OED) in 2014 to coordinate efforts in online educa- 
tion across campuses and has developed a series of 
services to support online learning.94 These services 
include 24/7 online tutoring in high-volume subjects, 
an online counseling platform that connects students 
to counselors from their own campus, and a set of 
online readiness tutorials. These help students eval- 
uate their readiness for online learning and provide 
students with information that may help them iden- 
tify barriers to success in online learning and make 
plans to address those barriers. A recent report on 
the pilot testing of OEI supports suggests that stu- 
dents in OEI pilot courses outperformed their peers 
in non-pilot courses.95 Although the evaluation was 
purely descriptive, it provides suggestive evidence 
that online learners may benefit from institutional 
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resources and services tailored for online learning 
specifically. Of course, providing additional resources 
alone will do little to improve online course perfor- 
mance if students do not use them. For resources to 
be most effective, colleges should ensure that services 
are clear, easy to use, and accessible to all students. 


Promoting Interpersonal Interactions. Inter- 
personal interactions are key to successful learn- 
ing in any environment. Researchers have proposed 
a number of ways to strengthen interpersonal com- 
munication in fully online courses, including assign- 
ing students to peer groups and incorporating 
small-group problem-solving activities to facilitate 
student-to-student interactions and providing syn- 
chronous online discussion sessions to improve 
instructor-student interaction by mimicking tradi- 
tional classroom interactions.9° Researchers also 
agree that creating opportunities for students to meet 
face-to-face with their instructors could substantially 
improve student-instructor relationships and stu- 
dent motivation, although this can be challenging for 
some students since they may have enrolled in online 
courses due to work schedules, family commitments, 
and other obligations.97 

In current online courses, the most common form 
of face-to-face meetings takes place through office 
hours. However, studies suggest that many students 
are uncomfortable seeking assistance from instructors 
through individual meetings and that office hour visits 
are often brief and underused.98 Based on these obser- 
vations, some researchers suggest providing structured 
group face-to-face meeting sessions as a substitute for 
office hours for answering student questions.99 


Warning and Monitoring. One great advantage of 
the virtual learning environment is its potential to 
identify at-risk students in a timely way, based on indi- 
vidual online learning behaviors that might otherwise 
go unnoticed in face-to-face lectures with large class 
sizes.!0° Based on student click stream and learning 
analytics data, online platforms can closely record 
when and how students access online materials and 
complete assignments. Colleges could incorporate 
early warning systems into online courses to identify 
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and intervene in helping struggling students before 
they withdraw from the course. For example, Kimberly 
Arnold and Matthew Pistilli used local course data to 
build predictive models that correlate disparate types 
of measures (such as online learning patterns, stu- 
dent surveys, and online learning diagnostics) with 
student course performance to identify students who 
are at risk of negative academic outcomes.!°! Early 
identification of at-risk learning behaviors can enable 
course instructors or counselors to take more proac- 
tive steps to determine whether a student is experi- 
encing problems and to discuss potential supports or 
solutions. Yet, the extent to which this strategy helps 
students succeed in online learning environments 
largely depends on the quality of follow-up supports 
that instructors and advisers provide. 
Faculty Professional Development. Online 
courses require students to assume greater respon- 
sibility for their learning; thus, a successful online 
student may need high levels of self-regulation and 
self-discipline.1°? Given the crucial importance of 
self-directed learning skills and time management in 
online success, researchers argue that students, espe- 
cially those from disadvantaged backgrounds, may 
need additional support or scaffolding to build those 
skills.1°3 For example, some researchers argue that it 
would be beneficial to provide online learners with 
the opportunity to pre-commit to studying course 
materials at a specific day and time, which in turn 
may provide students with a self-control mechanism 
to avoid procrastination.1°4 

It is not clear whether most online courses incor- 
porate such skill development or scaffolds when 
they are offered. However, a recent qualitative study 
at two community colleges found that many fac- 
ulty expected their online students to begin courses 
already equipped with self-directed learning skills 
and did not believe that faculty should be respon- 
sible for helping students develop those skills.1°5 
Colleges therefore may consider offering faculty pro- 
fessional development opportunities that inform 
online instructors of the challenges faced by students 
in online courses and ways to scaffold self-directed 
learning skills effectively. 
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Conclusion 


Online education is a growing industry, and students 
are choosing online learning in ever-greater num- 
bers. But is online education simply a substitute for 
in-person education, or can it instead expand access 
to students who would not otherwise have enrolled 
in an educational program? A review of the existing 
research on this topic provides suggestive evidence 
that online education can indeed expand access to 
college. The convenience of online learning is partic- 
ularly valuable to adults with multiple responsibilities 
and highly scheduled lives; thus, online learning can 
be a boon to workforce development, helping adults 
return to school and complete additional education 
that could otherwise not fit into their daily routines. 
From an institutional perspective, online courses 
allow colleges to offer additional classes or programs, 
increasing student access to required courses. Given 
the value of these benefits, online courses are likely to 
become an increasingly important feature of postsec- 
ondary education. 

Yet, the reasons students give for selecting online 
versus face-to-face delivery format seem to suggest 
that students suspected compromised learning expe- 
riences in a fully online course. If students indeed 
learn less well on average in online courses than in 
face-to-face courses, the current online expansion at 
higher education institutions may be at the cost of 
worse academic outcomes. A comprehensive review 
of the research literature reveals that, on average, stu- 
dents learn less well in online courses compared to 
similar students in face-to-face classes—particularly 
at two-year and nonselective institutions. Research 
finds that online learning can even exacerbate educa- 
tion inequality among different demographic groups, 
since online courses are substantially more prevalent 
at nonselective institutions that disproportionately 
enroll students from underrepresented groups and 
lower socioeconomic backgrounds. 

While some students may benefit substantially 
from a well-organized online course with high levels 
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of peer interactions and student-faculty interactions, 
maintaining these high-level interactions requires 
instructors to devote a substantial amount of time 
throughout the course. Students in high-interaction 
online courses report that instructors posted 
announcements on a regular basis to remind stu- 
dents about requirements and deadlines, responded 
to questions in a timely manner (typically, within 
24 hours), provided multiple ways for students to 
communicate with the instructor, offered personal 
feedback on students’ assignments, responded to 
individual student postings on the discussion forum, 
and were also more likely to ask for student feedback 
and were responsive to that input. All these activities 
require strong time commitments from the instruc- 
tor. As a result, colleges that contemplate bench- 
marking online course quality will need to take into 
account the workload on instructors in delivering a 
high-touch online class and the cost of supporting 
instructors in using sophisticated technology infra- 
structure and instructional platforms. 
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Appendix A 


Table Al. Experimental and Quasi-Experimental Evidence on the Impact of Online Learning on 


Student Outcomes 
Experi- Description 
ment Con- | of Online Outcome 
ditions Format Measures LGW a a litellite cy 
Experiment Studies 
US Department | K-12 and | 45 Face-to-Face; | Unspecified Meta- Unspecified 1. Positive Effects of 
of Education Higher Studies Bended; Analysis Fully Online and Blended 
(2009) Education Fully Online Format on Learning 
Outcomes 
Figlio, Rush, Research N=312 | Face-to-Face; | Online Lecture Random 1. Course Grade | 1. Negative Effects of Fully 
and Yin (2013) | Universities Fully Online with Access to Assignment Online Format on Course 
Face-to-Face Grade 
Meeting with 
Instructor and 
Graduate Student 
Teaching Assis- 
tants 
Bowen et al. Public Uni- | N=605 | Face-to-Face; | Interactive Online | Random 1. Course Grade | 1. No Format Effects on 
(2014) versities Blended Learning System | Assignment | 2. Com- Course Grade 
with Some prehensive 2. No Format Effects on 
Face-to-Face Assessment CAOS Posttest Scores 
Instruction of Outcomes 3. No Format Effects on 
in Statistics Course Completion 
(CAOS) 
3. Course Com- 
pletion with a 
Passing Grade 
Joyce et al. Public Uni- | N= 725 | Face-to-Face; | Online Learning Random 1. Course Grade | 1. Negative Effects on 
(2015) versities Blended System with One | Assignment | 2. Course Blended Format on Course 
75-Minute Face- Persistence Grade 
to-Face Lecture 3. Class Atten- | 2. No Format Effects on 
Each Week dance Course Persistence 
4. Study Time 3. No Format Effects on 
Class Attendance 
4. No Format Effects on 
Study Time 
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Experi- Description 
ment Con- | of Online Method- | Outcome 
ditions Format ology Measures Ga st litel lites 
Alpert, Couch, | Public Uni- | N=323 | Face-to-Face; | Blended Format: | Random 1. Course Grade | 1. Negative Effects of 
and Harmon versities Blended; Online Lectures Assignment Fully Online Format on 
(2016) Fully Online with a Weekly Course Grade Compared 
Face-to-Face Dis- to Face-to-Face Format; 
cussion Session No Difference Between 
Fully Online: On- Blended vs. Face-to-Face 
line Lectures with Format 
Online Synchro- 
nous Discussion 
Quasi-Experimental Studies 
Coate et al. Public Uni- | N=126 | Face-to-Face | Online Lecture Two-Stage | 1. Course Grade | 1. Negative Effects of Fully 
(2004) versities with Online with Online Least Online Format on Course 
Assignments; | Synchronous or | Squares Grade 
Fully Online Asynchronous Correction 
Discussion 
Xu and Jag- Community | N= Face-to-Face; | Unspecified Propensity | 1. Course Grade | 1. Negative Effects of Fully 
gars (2011) Colleges 22,219 Fully Online Score 2. Course Online Format on Course 
Matching Persistence Grade 
2. Negative Effects of Fully 
Online Format on Course 
Persistence 
Xu and Jag- Community | N= Face-to-Face | Unspecified Instrumental | 1. Course Grade | 1. Negative Effects of 
gars (2013) Colleges 22,624 (Less Than Variable 2. Course Online Format on Course 
50 Percent Persistence Grade 
Online); 2. Negative Effects of 
Online (over Online Format on Course 
51 Percent Persistence 
Online) 
Johnson and Community | N= Face-to-Face; | Online Lecture Instrumental | 1. Course 1. Negative Effects of Fully 
Mejia (2014) Colleges 126,509 | Online (over with Either Variable Completion with | Online Format on Course 
80 Percent Asynchronous Passing Grade | Completion 
Online) or Synchronous 
Interaction 
Streich (2014) | Community | N= Face-to-Face; | Unspecified Instrumental | 1. Course Grade | 1. Negative Effects of 
Colleges 112,566 | Blended; Variable 2. Course Fully Online and Blended 
Fully Online Persistence Format on Course Grade 
2. Negative Effects of 
Fully Online and Blended 
Format on Course Per- 
sistence 
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Experi- Description 
ment Con- | of Online Method- | Outcome 
ditions Format ology Measures Cas litel lites 
Xu and Jag- Community | N= Face-to-Face; | Unspecified Individual 1. Course Grade | 1. Negative Effects of Fully 
gars (2014) Colleges 498,613 | Fully Online Fixed Effects | 2. Course Online Format on Course 
Persistence Grade 
2. Negative Effects on 
Fully Online Format on 
Course Persistence 
Krieg and Hen- | Regional N= Face-to-Face; | Unspecified Fixed 1. Subsequent | 1. Negative Effects of On- 
son (2016) Compre- 38,652 Online (over Effects with | Course Grade line Format on Subsequent 
hensive 75 Percent Instrumental Course Grade 
Universities Online) Variable 
Bettinger et al. | Private N= Face-to-Face; | Online Lecture Instrumental | 1. Course Grade | 1. Negative Effects of Fully 
(2017) For-Profit 230,484 | Fully Online with Online Variable 2. Subsequent | Online Format on Course 
Universities Discussion and Course Grade Grade 
Group Projects 3. Subsequent | 2. Negative Effects of Fully 
Enrollment Online Format on Subse- 
quent Course Grade 
3. Negative Effects of Fully 
Online Format on Subse- 
quent Enrollment 
Hart, Fried- Community | N= Face-to-Face; | Online Lecture Student 1. Course Grade | 1. Negative Effects of Fully 
mann, and Hill | Colleges 440,405 | Fully Online with Either and Course | 2. Course Online Format on Course 
(2018) Asynchronous Fixed Effects | Persistence Grade 
or Synchronous 3. Course Com- | 2. Negative Effects of Fully 
Interaction pletion with a Online Format on Course 
Passing Grade | Persistence 
4. Course 3. Negative Effects of Fully 
Repetition Online Format on Course 
5. Subsequent | Completion 
Course Enroll- | 4. Fully Online Format 
ment Increases Likelihood of 
Same-Course Repetition 
5. Fully Online Format 
Decreases Likelihood of 
Subsequence Course 
Enrollment in the Same 
Subject 


Source: Authors. 
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